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INTRODUCTION 


PURPOSE. 

This  effort  was  directed  toward  the 
test  and  evaluation  of  the  pulsed 
acoustic  Doppler  wind  shear  sensing 
system  (PADWSS)  to  determine  if  the 
system  could  accurately  and  contin- 
uously sense  windspeed  and  wind 
direction  at  30-meter  (100-foot) 
intervals  between  a range  of  30  and 
510  meters  (100  and  1,500  feet) 
above  ground  level  (AGL). 

BACKGROUND. 

The  threat  presented  by  low-level 
wind  shear  to  aircraft  during  takeoff 
and  landing  operations  has  been 
emphasized  by  a number  of  wind  shear 
related  incidents  and  accidents  that 
have  occurred  in  the  past  several 
years.  Aircraft  making  landing 
approaches  have  descended  dangerously 
below  their  intended  glidepath 
resulting  in  contact  with  approach 
lights,  hard  short  landings,  or 
ground  contact  short  of  runway 
threshold . 

The  National  Transportation  Safety 
Board  (NTSB)  has  established  that 
strong  wind  shear  has  been  a prime 
contributory  factor  in  certain 
aircraft  accidents. 

The  Federal  Aviation  Administration 
(FAA)  has  established  several  concur- 
rent projects  to  help  provide  a 
solution  for  the  wind  shear  hazard. 
One  of  these  projects  utilizes  a 
dual-sensor  wind  shear  sensing  system 
consisting  mainly  of  a PADWSS.  The 
PADWSS  was  developed  by  the  Wave 
Propagation  Lab  (WPL)  of  the  National 
Oceanic  Atmospheric  Administration 


under  the  sponsorship  of  the  FAA. 
A pulsed  Doppler  radar  wind  shear 
sensing  system  (PDRWSS)  complements 
the  acoustic  system  when  precip- 
itation occurs. 


DISCUSSION 


The  PADWSS  system  was  installed  as 
part  of  a dual  sensor  system  at 
Dulles  International  Airport.  Figure 
1 depicts  a perspective  view  of  the 
dual-sensor  location  with  respect  to 
the  Dulles  terminal  and  runway  areas. 
The  PADWSS  was  installed  approxi- 
mately 1 mile  southwest  of  the  west 
end  of  runway  12R/30L  and  approxi- 
mately 3 miles  west  of  runway  1L/19R. 

Meteorological  records  at  Dulles 
indicate  that  weather  fronts  con- 
sistently approach  the  airport  from 
the  west.  Since  frontal  passages  are 
a cause  of  synop t ic -s c a 1 e wind 
shears,  it  was  desirable  to  locate 
the  system  at  a point  where  it 
would  detect  such  shears  before  they 
reached  the  airport  approaches. 
Another  important  aspect  of  the  site 
selected  was  the  relatively  low  back- 
ground noise  level.  Analysis 
of  air  traffic  patterns  also 
indicat’d  that  jet  aircraft  activity 
in  the  proximity  of  the  site  was 
light. 

The  PADWSS  was  designed  to  measure 
wind  conditions  between  heights  of  30 
to  510  meters  (100  to  1,500  feet)  AGL 
providing  vertical  wind  shear  data 
associated  with  synoptic  frontal 
changes  and  temperature  inversions. 
The  system  was  not  designed  to  sense 
low-level  horizontal  wind  shear  that 
is  normally  associated  with  gust 


SYSTEM  DESCRIPTION. 
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FIGURE  1.  SITING  CONFIGURATION — DULLES  ACOUSTICAL  DOPPLER  EQUIPMENT 


fronts  that  precede  thunderstorm  satellites  pulse  simultaneously  with 
arrival.  each  primary  pulse.  The  main  trans- 

mitter provides  measurement  from  150 
The  PADWSS,  shown  schematically  in  to  510  meters  (400  to  1,500  feet) 

figure  2,  consists  of  an  acoustic  height,  and  the  satellite  trans- 
transmitter which  is  an  off-axis  mitters  provide  wind  measurements 

parabolic  horn  antenna  with  a 12-  from  30  to  150  meters  (100  to  400 

driver  array  of  manifold  transducers.  feet). 

The  transmitter  emits  a 1,250-hertz 

acoustic  tone  burst  directed  ver-  The  sound  scattered  by  wind  energy 

tically  upward  into  the  atmosphere  imparts  a frequency  change  to  the 

every  18  seconds.  As  the  upward-  soundwave  called  a Doppler  shift.  A 

traveling  pulse  passes  through  the  digital  hardware  Fast-Fourier  trans- 

lower  atmosphere,  a small  amount  of  form  is  used  to  extract  the  Doppler 

sound  energy  is  scattered  out  of  the  frequency  shift.  Additional  calcu- 

9°  (inverted  cone)  beam  by  wind  lations  are  used  to  substract  noise, 

effect.  Three  parabolic  dishes  determine  signal-to-noise  ratio,  and 

placed  in  separate  bunkers,  approx-  evaluate  the  wind  profile.  This 

imately  300  meters  (1,000  feet)  from  is  displayed  on  a local  graphic 

the  main  transmitter  on  120°  radii,  terminal  and  archived  on  magnetic 

receive  the  scattered  signal  as  it  tape.  The  shifted  frequency  of  the 

:j  passes  through  the  acoustically  received  signal  provides  a measure  of 

* transparent  cover  of  the  bunker.  The  wind  velocity  and  wind  direction 

incoming  signal  is  reflected  by  the  which  is  vectorially  determined, 

parabolic  surface  and  is  collected  by 

receive  transducers.  The  receive  Data  from  two  acoustic  receivers  are 

antenna  is  electronically  steered  to  required  for  wind  measurement.  To 

seven  positions  along  vertical  determine  which  receivers  are  to  be 

axes.  The  reflected  energy  from  a used,  the  noise  level  of  each 

specific  altitude  arrives  at  the  receiver  is  measured  for  each  trans- 

receiver after  the  time  required  for  mitted  pulse.  Based  upon  least  noise 
the  sound  pulse  to  traverse  the  beam,  measurements,  a pair  of  receivers 
reach  altitude,  and  travel  to  the  is  selected  by  the  computer  for 

receiver.  Pulses  from  the  various  windspeed  calculations, 

altitudes  are  distinguished  by  the 

lag  time  between  transmit  and  receive  The  PADWSS  transmitter  pulse 

points.  After  receipt  of  signals  repetition  rate  of  18  seconds  is 

at  the  receivers,  they  are  pre-  close  to  the  maximum  update  rate  of 
amplified  and  conducted  by  cable  to  the  system.  However,  to  minimize 

the  equipment  site  building  which  is  rapid  fluctuations  in  the  measure- 

adjacent  to  the  transmitter.  Further  ments  (noise),  a running  average  rate 

analog  processing,  such  as  bandwidth  which  averaged  20  sample  measurements 

filtering,  is  followed  by  digiti-  (a  6-minute  period)  was  considered 

zation  and  input  to  a Nova  Eclipse  optimum.  The  information  so  derived 

Minicomputer.  was  formatted  and  transmitted  for 

display. 

Smaller  satellite  transmitters  are 

positioned  approximately  50  meters  The  high  sensitivity  of  the  receiver 

I (165  feet)  in  front  of  each  of  the  which  is  necessary  for  proper  oper- 

I three  receiver  sites.  The  smaller  ation  also  represents  a limitation 


FIGURE  2.  BLOCK  DIAGRAM — DULLES  PULSED  ACOUSTICAL  DOPPLER  WIND  SHEAR  SENSING  SYSTEM 
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on  system  capability.  High-level 
ambient  noise  and  overflying  by 
aircraft  affect  or  destroy  the 
required  slgnal-to-nolse  charac- 
teristics. Intermittent  noise  due  to 
an  aircraft  passage.  Is  handled  by 
rejection  filters  in  the  software. 
In  addition,  the  sound  of  heavily 
falling  rain  also  affects  or  destroys 
the  slgnal-to-nolse  characteristics 
of  the  acoustic  system;  therefore, 
the  pulsed  Doppler  radar  Is  auto- 
matically activated  during  periods 
of  precipitation. 

The  computer.  In  addition  to  deter- 
mining Doppler  frequency  shift, 
controlling  pulse  repetition  rate, 
beam  steering  for  receivers,  and 
performing  data  manipulation.  Is 
programed  to  compare  the  reliability 
of  the  acoustic  system  versus  the 
radar  system  and  to  graphically 
display  the  most  reliable  data. 
When  precipitation  Is  no  longer 
present,  the  radar  system  shuts  down 
automatically. 

TEST  OBJECTIVES. 

The  test  activity  was  planned  In  two 
stages.  If  the  results  of  stage  1 
proved  acceptable,  then  stage  2 was 
to  be  Initiated.  The  stages  are 
Identified  as  follows: 

STAGE  1 . Stage  1 Involved  contin- 
uously recording  the  wlndspeed  and 
direction  measured  by  the  PADWSS  and 
comparing  that  data  for  corresponding 
time  periods  with  data  accumulated  by 
the  following  systems: 

1.  A National  Aviation  Facilities 
Experimental  Center  (NAFEC)  instru- 
mented aircraft, 

2.  A boundary  layer  profiler  (BLP) 
which  Is  a tethered.  Instrumented 
balloon,  and 


3.  The  PDRWSS. 

If  the  results  of  these  data  com- 
parisons proved  accurate,  and  If  the 
PADWSS  did.  In  fact,  sample  wind 
conditions  that  truly  represented  the 
wlndspeed  and  wind  direction  for  the 
spatial  volume  of  the  air  terminal, 
and  If  an  Interim  assessment  of  the 
system's  operability  and  reliability 
proved  acceptable,  then  stage  2 would 
be  Initiated. 

STAGE  2.  Stage  2 was  to  design, 
develop,  and  evaluate  a digital 
display.  The  display  and  associated 
software  were  to  provide  wind  shear 
Information  when  predesignated 
vectorial  differences  attributable  to 
wlndspeed  and/or  wind  directional 
changes  for  preselected  height  ranges 
were  exceeded.  An  audio  alarm  and  a 
flashing  display  were  to  depict,  for 
the  user,  the  height  range  In  which 
the  most  hazardous  wind  shear  con- 
dition existed. 

It  was  planned  to  Install  .he  display 
In  the  Dulles  control  tower  and  have 
wind  shear  Information  relayed  to 
aircrews  by  ground  controllers. 
However,  this  second  stage  was  never 
Implemented. 

BRIEF  DESCRIPTION  OF  COMPARISON 
SYSTEMS. 

NAFEC-INSTRUMENTED  AIRCRAFT.  The 
aircraft  (a  Grumman  Gulfstream) 
utilizes  special  transducers,  an 
Inertial  navigation  system  (INS),  and 
a true  airspeed  computer  to  measure 
meteorological  and  navigational 
parameters.  Data  were  recorded  on 
magnetic  tape  for  5-second  averages. 

All  aircraft  runs  were  performed 
under  visual  flight  rules  (VFR) 


with  a minimum  windspeed  of  3 meters 
per  second  (m/s). 

Two  types  of  aircraft  runs  were 
performed.  They  are  described  as 
follows: 

Flat  Runs:  A flat  run  was 
accomplished  when  the  aircraft  flew 
directly  into  the  wind  at  preselected 
100-foot  heights  above  the  ground 
within  300  to  1,300  feet,  passing 
directly,  over  the  acoustic  system. 
The  aircraft  was  essentially  sampling 
the  same  3-  to  7-mile  extent  (length) 
of  air  at  a fixed  above-ground 
height  that  the  acoustic  system  had 
sampled . 

Glide  Slope  Approaches:  Data  were 
collected  when  the  aircraft 
approached  the  various  runways  at 
Dulles  Airport.  In  this  case,  the 
air  sampled  was  a substantial  dis- 
tance from  the  acoustic  system  and 
not  necessarily  the  same  air  that  the 
acoustic  system  sampled. 

BOUNDARY  LAYER  PROFILER.  The  BLP  is 
a kytoon ( tethered balloon)  with  a 
suspended  instrumentation  package 
that  senses  altitude,  windspeed,  wind 
direction,  wet  bulb  temperature,  and 
dry  bulb  temperature,  the  values  of 
which  are  telemetered  to  a receiver 
on  the  ground  and  recorded  on  a strip 


chart  recorder.  The  data  were 
later  digitized  for  comparison  with 
the  acoustic  data  for  specific  time 
elements  for  range  of  heights  between 
300  and  1,200  feet  AGL. 

PULSED  DOPPLER  RADAR  WIND  SHEAR 
SENSING  SYSTEM  (PDRWSS).  The  PDRWSS 
is  located  immediately  adjacent  to 
the  PADWSS  in  the  computer  building. 
A precipitation  sensor,  mounted  on 
the  roof,  automatically  activates  the 
radar  when  the  appropriate  moisture 
content,  in  the  atmosphere,  is 
experienced.  The  radar  provides  wind 
information  by  measuring  the  radial 
velocity  of  the  wind  at  100-foot 
increments,  in  the  height  range  from 
300  to  1,300  feet,  in  the  north, 
east,  south,  and  west  azimuths  and 
combines  the  sensed  measurements  into 
values  of  windspeed  and  direction. 
Data  are  recorded  on  magnetic  tape 
along  with  the  data  from  the  PADWSS. 
The  appendix  shows  a ty^.ical  listing 
of  both  acoustic  and  radar  data. 
Accompanying  this  listing  are  the 
equations  used  in  the  statistical 
analysis . 

ACOUSTIC  VERSUS  AIRCRAFT. 

Table  1 depicts  the  total  number  of 
aircraft  runs  and  data  points  made 
to  accumulate  data  for  comparison 
with  the  PADWSS. 


TABLE  1.  AIRCRAFT  RUNS  AND  DATA  POINTS 


Type  Run 

Number  of  Runs 

Number  of  Data  Points 

Flat  Runs 

22 

1,000 

Glide  Slope  Runs 

24 

930 

TOTAL 

46 

1,930 

Note:  A data  point  represents  both  a windspeed  and  wind  direction. 
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WINDSPEED . Table  2 depicts  the 
results  for  statistical  computations 
for  wlndspeed.  The  mean  difference 
In  wlndspeed  for  flat  runs  was  -0.67 
m/s  (1.30  knots)  for  flat  runs  with 
a standard  deviation  of  2.i'3  m/s 
(5.11  knots). 


The  mean  difference  In  wlndspeed  for 
glide  slope  approaches  was  -0.15 
m/s  (0.29  knots),  a more  acceptable 
value,  but  with  a standard  deviation 
of  2.65  m/s  (5.15  knots).  The 
magnitude  of  these  standard  deviation 
values  can  be  attributed  to  the 
averaging  of  aircraft  data  for 

5- second  Intervals;  whereas,  the 
acoustic  system  Is  averaged  over  a 

6- mlnute  period.  Since  averaging 
the  data  over  a long  period  of  time 
smooths  the  effect  of  turbulence, 
much  of  the  scatter  measured  may  be 
attributed  to  the  difference  In 
sampling  techniques.  To  demonstrate 
this  point,  the  aircraft  data  from 
run  14  of  September  13,  1977,  was 
averaged  over  a 2-mlnute  (Instead  of 
5-second)  period  versus  6 minutes  for 
the  acoustic  system,  and  the  standard 
deviation  of  the  wlndspeed  fell  to 
less  than  1.1  m/s  (2.14  knots). 


WIND  DIRECTION.  Table  3 depicts  the 
results  for  statistical  computations 
for  wind  direction.  The  corrected 
mean  differences  reflect  compensation 
for  true  north  used  by  aircraft 
Instrumentation  versus  magnetic  north 
used  for  the  acoustic  systems. 


The  mean  difference  In  direction 
between  the  acoustic  system  and  the 
aircraft  was  -7.2°  for  the  flat  runs 
and  -7.4°  for  glide  slope.  Much  of 
this  difference  Is  a consequence  of 
the  acoustic  system  using  true  north 
and  the  aircraft  using  magnetic 
north.  If  the  difference  between 
true  and  magnetic  north  Is  accounted 
for  (6.5°),  the  mean  differences  are 
less  than  1°. 


The  standard  deviations  of  10.4°  for 
flat  runs  and  20.9°  for  glide  slope 
approaches  are  fairly  large  and  can 
be  attributed  to  the  aircraft  data 
averaging  over  5 seconds  versus  6 
minutes  for  the  acoustic  system. 


The  standard  deviation  for  glide 
slope  runs  was  approximately  twice  as 
large  as  flat  runs  (21°  versus  10°); 
however,  this  can  be  attributed  to 


TABLE  2.  ACOUSTIC  SYSTEM  VERSUS  AIRCRAFT — WINDSPEED 


Type  Run 

Flat  Runs 

Glide  Slope  Runs 


Mean  Differences 
In  Wlndspeed  m/s  (knots) 


-0.67  (1.30) 
-0.15  (0.29) 


2.63  (5.11) 
2.65  (5.15) 


Note:  A negative  sign  for  the  mean  values  Indicates  that  the  aircraft-sensed 
wlndspeeds,  on  average,  were  greater  than  the  acoustic  system-sensed  wlndspeeds. 


Standard  Deviations 
In  Wlndspeed  m/s  (knots) 


TABLE  3. 


ACOUSTIC  SYSTEM  VERSUS  AIRCRAFT —WIND  DIRECTION 


I ■ 


Type  Run 


Mean  Differences 
In  Direction 
(degrees) 


Flat  Runs  -7.2 

Glide  Slope  Runs  -7.4 


Corrected  Mean 
Difference  In 
Direction 
(degrees) 

-0.7 

-0.9 


Standard  Deviation 
In  Direction 
(degrees) 

10.4 

20.9 


Note:  A negative  sign  indicates  that  the  aircraft-sensed  directions,  on  the 
average,  were  greater  than  the  acoustic  system-sensed  directions. 


crosswinds  encountered  on  glide  slope 
approaches.  The  error  in  direction 
is  a function  of  the  difference 
between  the  aircraft  heading  and  the 
wind  direction.  (Note  that  flat  runs 
were  headed  directly  into  the  pre- 
vailing wind.) 

ACOUSTIC  VERSUS  BLP. 


(19.44  knots).  In  addition,  the  BLP 
data  were  instantaneous  with  no 
averaging  versus  acoustic  system 
6-minute  averaging. 

The  BLP  was  always  flown  within  a 
1,000  feet  of  the  acoustic  system; 
therefore,  it  sensed  essentially  the 
same  air  as  the  acoustic  system. 


Table  4 depicts  the  total  hours  of 
comparison  time,  26.7,  for  acoustic 
versus  BLP  and  the  total  number  of 
BLP  data  points.  Table  5 depicts  the 
statistical  computations  for  wind- 
speed  and  wind  direction.  The 
results  of  the  BLP  comparisons  were 
similar  in  pattern  to  the  aircraft 
comparisons;  that  is,  the  mean 
differences  were  less  than  0.1  m/s 
(0.19  knots)  for  windspeed  and  4.6° 
for  adjusted  direction,  after  compen- 
sation for  true  and  magnetic  norths. 
The  standard  deviations  were  1.2  m/s 
(2.33  knots)  for  windspeed  and 
23.3°  for  direction. 

Some  of  the  deviation  in  direction 
was  probably  attributable  to  the 
suspended  instrumentation  package  in 
the  BLP  being  subjected  to  swaying, 
oscillation,  and  flutter  (vibration) 
when  the  windspeed  approaches  10  m/s 


ACOUSTIC  VERSUS  RADAR. 

Table  6 depicts  the  approximate 
number  of  hours  during  which  the 
reliability  values  established  by  the 
system  developer  were  high  enough  to 
allow  a meaningful  comparison  of  the 
acoustic  system  (PADWSS)  with  respect 
to  the  radar  system  (PDRWSS). 

When  reviewing  these  acoustic  versus 
PDRWSS  data,  it  became  apparent  that 
the  data  should  be  categorized  for 
more  meaningful  evaluation.  The 
breakdowns  are  given  below. 

NOVEMBER/DECEMBER  1977  DATA  (6-MINUTE 
AVERAGES ) . This  breakdown  was 
established  when  it  was  noted  that 
large  standard  deviations  applied  for 
that  time  period.  Detailed  con- 
sideration coupled  with  onsite 
experience  led  to  the  conclusion 


8 


TABLE  A. 


ACOUSTIC  SYSTEM  VERSUS  BOUNDARY  LAYER  PROFILER 


I 

i 


Acoustic  Versus  BLP 

Comparison  Time  Number  of  BLP 

(hr)  Data  Points 


26,7 


6,150 


Note:  A data  point  represents  both  windspeed  and  wind  direction. 


TABLE  5.  ACOUSTIC  SYSTEM  VERSUS  BLP 


i 

[ 

1 


I 


Windspeed  m/s  (knots) 


Mean 

Difference 
-0.1  (0.19) 


Standard 

Deviation 

1,2  (2.33) 


Wind  Direction  (degrees)  -4.6  23.3 

Note:  Wind  direction  is  corrected  for  the  difference  between  true  and  magnetic 
north.  A minus  sign  for  the  mean  difference  indicates  that  the  BLP  values 
were  greater  than  the  acoustic  values. 


I 

I 


that  the  absence  of  leaves  on  the 
trees  in  combination  with  occasional 
snow  cover  adversely  affected  the 
acoustic  system's  signal-to-noise 
ratio.  Without  the  green  foliage 
which  absorbs  noise,  the  reverber- 
ations were  at  a higher  level. 
Snow  cover  also  contributed  to  this 
ground  clutter  by  reflecting  the 
transmitted  pulses.  Another  factor 
that  contributes  significantly  to 
ambient  noise  is  dry  leaf  movement  in 
the  bunker  areas. 

A review  of  the  mean  differences 
(table  6)  of  1.1  m/s  (2.14  knots)  in 
windspeed  and  9°  in  the  wind 
direction  provides  small  concern,  but 
the  large  standard  deviations  are 


cause  for  concern.  Based  on  2-sigma 
statistical  computations,  one  could 
expect  the  direction  output  for  the 
acoustic  system  to  fall  anywhere 
within  ^122°  (standard  deviation  = 
61°)  of  the  mean  direction  95 
percent  of  the  time  and  the  windspeed 
to  fall  within  ^5.6  m/s  (+11.2  knots) 
(standard  deviation  * 2.^  m/s  (5.44 
knots))  of  the  true  windspeed  95 
percent  of  the  time  for  similarly 
described  environmental  conditions. 

SEPTEMBER  THROUGH  OCTOBER  1977  DATA 
(2-MINUTE  AVERAGeTT  in  order  to 
study  the system' s response  to 
rapidly  changing  weather  conditions 
(such  ss  thunderstorms),  it  was 
decided  to  lower  the  averaging  time 
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TABLE  6.  ACOUSTIC  SYSTEM  VERSUS  RADAR  SYSTEM 
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I;  from  6 minutes  to  2 minutes.  The 

I,  effects  of  this  change  were  studied 

t during  a 6-week  period,  and  it  was 

determined  that  the  averaging  change 
made  the  system  much  more  sensitive 
to  noise  and  consequently  lowered  the 
profile  reliability. 

Referring  to  table  6,  it  can  be  noted 
that  the  mean  differences  and  stan- 
dard deviations  for  the  2-  and 
6-minute  averages  are  in  close 
agreement;  however,  the  2-minute 
averaging  time  did  adversely  affect 
the  profile  reliability  (refer  to 
Profile  Reliability  section).  This 
implies  that  the  change  in  averaging 
time  does  not  affect  the  quality  of 
the  output,  but  only  the  quantity  of 
acceptable  output. 

MARCH  THROUGH  JULY/MID-OCTOBER 
THROUGH  MID-NOVEMBER  (6-MINUTE 
AVERAGES ) . The  s y s t em  norma  1 ly 
operates  on  6-minute  averages.  Table 
6 depicts  the  mean  differences  and 
standard  deviations  for  both  wind- 
speed  and  wind  direction  for  the 
statistical  comparisons.  This 
breakdown  presents  the  most 
functional  data.  The  system 
developer  (WPL)  had  indicated  that 
when  the  averaging  time  was  lowered, 
the  average  spectra  was  increasingly 
susceptible  to  perturbation  by  noise 
from  ground  wind  and  jet  aircraft. 
Our  observations  confirmed  this 
information.  The  data  in  the 
appendix  are  part  of  this  category  of 
data. 

TOTAL  ACOUSTIC  VERSUS  RADAR.  A total 
of  475  hours  of  comparative  data  for 
the  acoustic  versus  radar  was  accu- 
mulated, This  value  is  the  result  of 
computations  for  the  complete  data 
set. 


ASSIGNMENT  OF  SYSTEM  ERROR. 

Part  of  NAFEC  responsibility  in  the 
evaluation  process  was  to  appraise 
the  accuracy  and  repeatability  of  the 
acoustic  system.  There  was  no 
established  standard  to  use  for 
comparative  purposes;  that  is, 
neither  the  radar,  BLP,  nor  the 
aircraft  could  be  considered  as  a 
standard.  Therefore,  the  rationale 
for  assigning  acoustic  system  values 
is  described  under  the  following 
headings.  * 

WINDSPEED  RATIONALE.  The  following 
rationale  and  computations  were 
utilized. 

Acoustic  Versus  Radar.  Since 
each  system  was  sampling  at  the  same 
time,  an  assumption  was  made  that  ^ 

both  the  acoustic  system  and  the 
radar  system  contributed  equally  to 
the  standard  deviation  of  the  dif- 
ferences for  that  time  period  when 
6-minute  averages  were  being  recorded 
(normal  operation).  This  assumption 
was  based  on  engineering  judgment 
after  detailed  observations  of  the 
data  patterns  and  the  knowledge  that 
the  two  systems  are  not  sampling 
the  same  air.  A review  of  recorded 
data  led  to  the  conclusion  that  when 
the  moisture  content  of  the  environ- 
ment was  adequate,  as  reflected  in 
the  profile  reliability  of  the  radar 
system,  the  radar  system  was  insen- 
sitive  to  changes  in  the  level 
of  magnitude  of  windspeed;  therefore, 
the  radar  system  accuracy  was 
consistent.  Referring  to  table  7, 
the  standard  deviation  for  comparison 
of  acoustic  versus  radar  was  2.1  m/s  — — 

(4.08  knots).  It  was  determined  that 
an  equal  assignment  of  1.5  m/s  (2,92 
knots)  be  allocated  to  both  the 
acoustic  and  radar  systems  for 
6-minute  average  data. 
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TABLE  7.  CALCULATED  STANDARD  DEVIATIONS  FOR  WINDSPEED--METERS/SECOND  (KNOTS) 
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Note:  Refer  to  the  text  under  wlndspeed  rationale  for  a description  of  the  assumptions  made  to  compute 
this  table.  NA  means  not  applicable  for  this  type  comparison. 


1.5  m/s  (2.92  knots)  for  the  system  resulted  in  a comparatively  low 
resulted  in  the  following  calculated  standard  deviation  for  BLP  versus 
standard  deviation  values  for  the  acoustic  of  1.2  m/s  (2.33  knots) 
acoustic  system.  They  were:  (table  7).  For  this  comparison,  it 

was  assumed  the  acoustic  and  BLP 

1.  September — Mid-October  “ 1.6  m/s  system  equally  contributed  to  half  of 

(3.11  knots)  (2-Minute  Averages)  the  deviation;  therefore,  the  respec- 

tive deviations  were  0.85  m/s  (1.65 

2.  November/December  1977  * 2.4  m/s  knots).  The  reduced  deviation  at  low 

(4.67  knots)  (6-Minute  Averages)  windspeed  implies  that  as  windspeed 

increases,  so  does  the  uncertainty 

3.  Total  “ 1.6  m/s  (3.11  knots)  associated  with  the  acoustic  systems 

measurement  of  windspeed. 

Acoustic  Versus  Aircraft  Instru- 
ment at  ion.  The  calculated  standard  Summary  for  Windspeed  Rationale, 

deviation  for  windspeed  for  6-minute  in  sunmiary,  for  windspeed  rationale, 

averages  for  the  acoustic  system  was  ^he  engineering  requirement  iden- 

subsequently  used  in  the  formula  to  tifies  an  accuracy  of  ■♦•5  knots 

determine  the  standard  deviation  for  (2.57  m/s).  This  requir^ent  was 

windspeed  attributable  to  the  air-  interpreted  as  being  two  standard 

craft's  instrument  system;  this  deviations,  which  means  that  any 

resulted  in  a standard  deviation  system  which  met  this  requirement 

of  2 m/ s (3.89  knots)  for  the  air—  would  output  data  that  would  be 

craft  (table  7).  Some  of  the  within  +5  knots  95  percent  of  the 

difference  can  be  attributed  to  the  time.  This  converts  to  one  standard 

short  averaging  time  for  the  aircraft  deviation  of  1.3  m/s  (2.53  knots), 

data. 

Per  the  data  from  table  7,  the 
Acoustic  Versus  BLP.  The  following  is  condensed: 

maximum  allowable  windspeed  for  BLP 


Calculated 

Engineering  Requirement 

1 Std.  Dev. 

1 Std.  Dev. 

I 

Type  of  Comparison 

m/s  (knots) 

m/s  (knots) 

f 

March — Ju ly/M id-Oc  t ober — Mid-November 
Acoustic  (compared  with  radar,  6-minute 
average) 

1.5  (2.92) 

1.3  (2.53) 

r 

♦ 

September — Mid-October 

Acoustic  (compared  with  radar,  2-minute 
average) 

1.6  (3.11) 

1.3  (2.53) 

1 

1 

November/December  1977 

Acoustic  (compared  with  radar, 
6-minute  average) 

2.4  (4.67) 

1.3  (2.53) 

Acoustic  (compared  with  aircraft) 

1.6  (3.11) 

1.3  (2.53) 

Acoustic  (compared  with  BLP) 

0.85  (1.65) 

1.3  (2.53) 
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WIND  DIRECTION  RATIONALE.  Similar 
rationale  and  computations  were 
utilized  in  determining  the  standard 
deviations  for  the  wind  direction  as 
used  in  the  windspeed  rationale. 

Acoustic  Versus  Radar.  It  was 
assumed  that  the  acoustic  system  and 
the  radar  system  equally  contributed 
to  the  comparative  standard  deviation 
of  33°  for  March — July/Mid-October — 
Mid-November,  6-minute  average  data 
(refer  to  table  8).  Applying  a 
formula  for  distribution  of  assigned 
contribution  of  error  resulted  in  a 
standard  deviation  value  of  23.3°  for 
both  the  acoustic  and  radar  systems. 

Reference  should  be  made  to  table  8, 
which  depicts  March--July/Mid- 
Oc t obe r--M id-November  (6-minute 
averages);  and  November /December 
(6-minute  averages)  wind  direction 
values.  Particular  attention  should 
be  given  to  the  standard  deviation 
established  for  the  November/December 
1977  time  period  when  the  acoustic 
system  was  adversely  affected  by 
environmental  conditions  (bare  trees 
and  snow  cover).  The  acoustic 
system's  standard  deviation  for  that 
time  period  indicates  a potential  of 
error  equivalent  to  approximately 
113°  (2-standard  deviations),  strong 
evidence  that  the  system  fails 
to  function  accurately  in  all 
environments. 

Acoustic  Versus  Aircraft  Instru- 
mentat ion.  Allowing  for  atmospheric 
conJicions  and  other  factors,  the 
standard  deviation  for  the  acoustic 


system  was  10°  (refer  to  table  8). 

Utilizing  these  same  allowances  for 
aircraft  flat  runs  resulted  in  a 
standard  deviation  of  3.0°  for  the 
aircraft,  a reasonable  value  for 
aircraft  heading  directly  into  the 
wind,  where  errors  in  measuring 
direction  are  minimized. 

For  the  glide  slope  approaches, 
assigning  the  same  10°  standard 
deviation  to  the  acoustic  system,  the 
aircraft  was  subjected  to  crosswind 
influence,  and  a standard  deviation 
of  18.4°  resulted. 

Acoustic  Versus  BLP.  Based  on 
the  standard  deviation  of  10° 
assigned  to  the  acoustic  system  when 
compared  to  the  aircraft  and  the 
similarity  in  atmospheric  conditions 
for  flight  days  for  aircraft  and  BLP, 
it  was  decided  to  assign  a standard 
deviation  of  10°  to  the  acoustic 
system  for  BLP  comparisons.  By  a 
deductive  computation,  this  resulted 
in  the  assignment  of  21°  of  standard 
deviation  to  the  BLP  from  the  com-  j 

parative  standard  deviation  of  23.3°.  | 

This  assignment  of  21°  appears  ] 

reasonable  when  one  considers  the  ' 

swaying,  oscillations,  and  flutter  I 

that  the  BLP  experiences  under  j 

varying  wind  conditions  (refer  to 
table  8). 

Summary  For  Wind  Direction 
Rat ionale . Meaningful  comparisons  i 

are  summarized  for  wind  direction 
rationale.  The  engineering  require- 
ment identified  an  accuracy  of  ^20° 
which  equates  to  1 standard  deviation 
of  10°. 
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TABLE  8.  CALCUL/'.iiS  STANDARD  DEVIATIONS  FOR  WIND  DIRECTION— DEGREES 


Note:  NA  means  not  applicable  for  this  type  of  comparison.  The  values  tabulated  above  were  computed 
using  the  assumptions  described  In  the  text  under  Wind  Direction  Rationale. 


PROFILE  RELIABILITY  ANALYSIS, 


The  results  are  unfavorable  for 
acoustic  when  conpared  to  radar, 
particularly  for  the  November/ 
December  1977  described  con- 
ditions. This  degree  of 
variation  would  have  an  adverse 
effect  on  display  operation. 
Algorithms  were  to  be  developed  that 
would  allow  the  computer  to  sense 
vector  differences  attributable  to 
change  in  wind  direction  and/or 
wind  velocity  for  values  as  low 
as  10  knots  between  preselected 
height  ranges  above  ground  level. 
The  large  angular  deviations  may 
have  caused  false  alarms  for  air 
traffic  controllers  if  stage  2 had 
been  implemented  or  possibly  allowed 
a hazardous  condition  to  develop 
without  sensing  it  because  of  the 
exceedingly  large  element  of  error. 

Per  table  8,  the  following  is 
condensed  for  standard  deviations: 


As  previously  indicated,  a program 
was  developed  to  determine  the  per- 
centage of  time  when  the  acoustic 
systems  profile  reliability  was  equal 
to  or  exceeded  a discrete  value  of 
30,  as  identified  by  the  system 
developer.  The  results  of  this 
analysis  are  tabulated  in  table  9.  A 
review  of  the  table  will  indicate 
that  when  March— July/Mid-October- 
Mid-November  6-minute  averaging  was 
used  (normal  operating  average), 
data  were  available  92  percent  of  the 
time.  This  figure  diminished  to  85 
percent  when  September — ^Mid-October 
2-minute  averages  were  used  and 
further  diminished  to  72  percent 
during  the  conditions  previously 
described  for  the  November/ 
December  6-minute  averages. 

A program  was  used  to  measure  the 
profile  reliability  of  the  acoustic 


Calculated 
1 Std.  Dev. 


Type  of  Comparison  (degrees) 


Acoustic  compared  with  radar 
March — July /Mid -October — 

Mid-November  (6-minute  average)  23.3 

Acoustic  (compared  with  radar) 

November/December  (6-minute 

averages)  56.4 

Acoustic  (compared  with  aircraft, 
glide  slopes)  10.0 

Acoustic  (compared  with  BLP)  10.0 


Engineering  Requirement 
1 Std.  Dev. 

(degrees ) 


10.0 


10.0 

10.0 

10.0 
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TABLE  9 


PROFILE  RELIABILITY  ANALYSIS 


i 

! 

h 


p 

r. 

t? 


ci 


Vi 


I 

ii 


,i 


I 


Condition 

Influencing 

Acoustic  Operation 

Number 
of  Data 
Points 

Number  of 

Points  With 

Good  Reliability 

Percent 

Data 

Available 

Ambient  Conditions 

November /December  1977 
6-Mlnute  Averages  of 

Acoustic  Data 

94,486 

67,930 

71.9 

September — ^Mid-October 
2-Mlnute  Averages  of 

Acoustic  Data 

189,098 

160,833 

85.1 

March — July /Mld-Oc  tober — 
Mid-November  6-Mlnute 
Averages  of  Acoustic 

Data 

469,620 

429,910 

91.5 

Overall  Acoustic 

Operation 

753,204 

658,673 

87.4 

Note:  Time  elements  for  each  breakdown  for  this  analysis  were  as 
Identified  In  table  6. 


[ 


I 


£ 

I 

5: 

I 
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TABLE  10.  PROFILE  RELIABILITY 
OF  5 METERS/SECOND 

ANALYSIS  WITH 

GROUND  WINDSPEED  IN 

EXCESS 

Condition 

Influencing 

Acoustic  Operation 

Number 
of  Data 
Points 

Number  of 

Points  With 

Good  Reliability 

Percent 

Data 

Available 

Ambient  Conditions 

November /December 

6-Minute  Averages  of 

Acoustic  Data 

7,830 

4,367 

55.8 

September — Mid-October 
2-Mlnute  Averages  of 

Acoustic  Data 

10,980 

8,298 

75.6 

March — July /Mid-October — 
Mid-November  6-Minute 
Averages  of  Acoustic 

Data 

28,658 

22,933 

80.0 

Overall  Acoustic 

Operation 

47,466 

33,598 

75.0 

Note:  Time  elements  for  each  breakdown  for  this  analysis  were  as 
identified  in  table  6. 
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system  whenever  the  ground  windspeed 
exceeded  5 m/s  (9.72  knots).  Table 
10  shows  that  the  profile  reliability 
diminished  substantially  for  all 
categories.  For  March--July /Mid- 
October — Mid-November  6-minute 
averaging,  the  reliability  changed 
from  91.5  to  80.0.  For  2-minute 
averages,  the  reliability  changed 
from  85.1  to  75.6.  For  the  November/ 
December  1977  period,  it  changed  from 
71.9  to  55.8. 

When  the  ground  windspeed  exceeded  10 
m/s  (19.44  knots),  the  programed 
analysis  indicated  that  the  profile 
reliability  almost  invariably  failed 
to  exceed  the  established  minimum 
value  of  30,  which  for  practical 
applications  made  the  data  useless. 
Onsite  observations  of  the  profile  as 
displayed  on  a cathode-ray  tube  (CRT) 
substantiated  this  condition.  The 
data  analysis  indicated  that  this 
condition  existed  for  approximately  2 
out  of  5,933  hours  of  total  uptime. 

Additional  evaluation  indicated  that 
the  higher  ACL  height  measurements 
failed  to  meet  the  minimum  profile 
reliability  test  regularly  when  the 
winds  at  the  30-meter  (100-foot) 
level  exceeded  8 m/s  (15.5  knots). 
When  the  winds  at  that  same  level 
exceeded  11  m/s  (21.38  knots),  the 
wind  profiles  were  discontinuous,  and 
the  wind  information  for  every 
30-meter  (100-foot)  height  was  not 
sensed.  These  conditions  were  also 
evidenced  through  onsite  observation 
of  the  CRT  display. 

In  summary,  this  analysis  and  obser- 
vations further  substantiate  the 
unsuitability  of  the  system  for  air 
traffic  controller  use. 


DOWNTIME  ANALYSIS. 

Table  11  has  been  assembled  on  the 
basis  of  information  extracted  from 
a daily  log.  One  column  identifies 
the  cause  of  downtime  by  event,  and 
in  some  cases,  the  events  are  further 
defined  with  subevents.  An  adjunct 
column  identified  the  hours 
attributable  to  events  and  subevents, 
where  applicable,  and  the  remaining 
column  identifies  the  downtime 
percentage  of  total  hours.  Most 
of  the  events  and  subevents  are 
self-explanatory;  however,  some  of 
them  require  amplification  or 
clarification. 

ITEM  4 - HARDWARE  PROBLEM.  FFT.  This 
item  was  a Fast-Fourier  transform 
(FFT)  board.  The  item  was  returned 
to  the  contractor  in  California  for 
two  independent  failures.  No  spare 
board  was  provided.  Each  time  that 
the  FFT  failed,  it  had  to  be  recycled 
at  least  twice  per  failure  to  and 
from  the  contractor  for  correction. 
Obviously,  the  final  assembly  test 
the  manufacturer  had  developed 
was  not  adequate.  Almost  2,800  hours 
can  be  attributed  to  this  failure 
alone . 

ITEM  5 - "QUICK"  LOOK.  This  routine, 
used  for  extracting  a recorded 
information  from  magnetic  tapes 
onsite,  preempted  computer  data 
col lect ion. 

ITEM  7 - SOFTWARE  CHANGES.  This  item 
occurred  as  a result  of  modifications 
incorporated  per  the  recommendation 
of  the  system  developer. 

DOWNTIME  COMMENTS  AND  CALCULATIONS. 
Both  items  5 and  7 would  not  occur 
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TABLE  11.  DOWNTIME  SUMMARY 


TOTAL  HOURS  OF  OPERATION:  10,176  (2/15/77  TO  4/15/78) 


Item 

Cause  of  Downtime 

Downtime 

% of  Total 

1 

Tape  Changes: 

Normal 

1 

Aircraft  Runs 

33.  5 

1 9.  5 43.  0 

0.  3 

0.  1 0.  4 

2 

System  Maintenance: 
Replace  Parts 

Pointing  Angles 
Electronic  Checks 

37.  0 

14.  0 

10.5  61.5 

0,4 

U.  1 

0.  1 0.  6 

3 

Computer  Maintenance: 
Repairman  on  Site 

Wait  for  Parts 

40.  0 

215.  0 255.0 

0.4 

2.1  2.5 

4 

Hardware  Problem- -FFT: 
Wait  for  Data  General 

D.  G,  Repairman  on  Site 
NAFEC/WPL  Working 
on  FFT 

Wait  for  Parts  D.  G. 

Wait  for  FFT 

Online/No  Tape 

116.  0 

106.  5 

92.  5 

240.  0 

2,  688.  0 

110.  0 3.  353.0 

1.4 

1.  0 

0.9 

2.4 

26.4 

1.1  33.0 

5 

"Quick”  Look 

34. 2 34. 2 

0.  3 0.  3 

6 

Install  CRT  at  National 
Weather  Service 

13.5  13.5 

0.  1 0.  ] 

7 

Software  Changes 

39.0  39.0 

0.4  0.4 

8 

Power  Outages: 

Lightning 

Other- -Wind  and  Ice 

88.  8 

76.0  164.8 

1 

0.  9 

0.7  1.6 

9 

Miscellaneous  Computer 
Crashes 

60.4  60.4 

0.  7 0.  7 

10 

Miscellaneous 

218.7  218.7 

2.  1 2.  1 

TOTAL  DOWNTIME 

1 

4. 243. 1 

41.  7 

under  pure  operational  conditions • 
Item  8 was  curtailed  and  effectively 
reduced  when  an  uninterruptible  power 
supply  was  installed  in  November  1977 
which  provided  backup  battery  power 
for  1/2  hour  when  utility  power 
was  interrupted.  This  reduced  the 
frequent  computer  crashes  that 
occurred  because  of  momentary  power 
interruptions. 

If  adequate  spares  are  provisioned 
and  most  of  the  unneeded  events 
are  eliminated,  the  downtime  could 
substantially  be  reduced  to 
approximately  727  hours  in  10,000 
hours  or  7.25  percent  of  total 
operating  time.  This  estimate 
is  based  on  limited  onsite  experience 
and  makes  no  allowance  for  system 
degradation. 

A mean  time  between  failures  (MTBF) 
of  178  hours  and  a mean  time  to 
repair  (MTTR)  of  115  hours  were 


calculated  from  dally  (hourly)  logs 
maintained  onsite.  MTBF  equates  to 
about  one  failure  every  7 1/2  days 
and  MTTR  equates  to  about  5 days  to 
repair  the  system  once  a failure 
occurred. 

These  values  can  be  reduced  by 
provisioning  a spare  FFT  board.  If 
one  had  been  available,  the  repair 
could  have  been  implemented  in 
approximately  20  hours.  If,  in 
addition,  an  unlnterruptable  power 
supply  had  been  installed  prior  to 
the  start  of  evaluation,  the  MTBF 
would  have  been  approximately  250 
hours.  Major  redesign  would  be 
required  to  improve  upon  these 
values. 

A major  portion  of  the  failure 
associated  with  items  3,  4,  and  8 
could  be  attributed  to  storm  activity 
or  power  interruptions  or  failure. 
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CONCLUSIONS 


From  Che  results,  It  was  concluded 
that: 

1.  The  evaluated  PADWSS  system  cannot 
be  utilized  on  an  operational  basis 
to  provide  accurate,  timely,  wind 
shear  Information  to  potentially 
affected  aircrews. 

2.  The  acoustic  system  failed,  by  a 
wide  margin,  to  meet  Che  standard 
deviation  (repeatability)  values  for 
direction,  calculated  per  the 
engineering  requirements.  (The 
engineering  requirement  (FAA  ER-450- 
130B)  Identified  a repeatability  of 
+5  knots  and  +20°  which  transcribes 
to  an  acceptable  2 standard  deviation 
of  2.53  m/s  and  10°  for  all  weather 
conditions. ) 

3.  The  system  validity  Is  affected  by 
environmental  conditions  and  ground 
wlndspeeds.  When  trees  were  bare. 


snow  covered  the  ground,  and  ground 
wlndspeeds  exceeded  5 m/s  (9.72 
knots),  valid  data  output  dropped  to 
56  percent  of  the  time. 

4.  When  the  ground  wlndspeed  exceeded 
10  m/s  (19.44  knots),  no  data  output 
was  available  from  the  PADWSS. 

5.,  When  the  wlndspeed  at  the  30-meter 
(100-foot)  level  exceeded  8 m/s 
(15.55  knots),  the  upper  AGL  height 
measurements  would  fall  to  meet 
the  established  profile  reliability 
criteria. 

6.  These  aforementioned  environmental 
conditions  could  occur  at  times 
when  hazardous  wind  shear  conditions 
exist. 


RECOMMENDATION 


It  Is  recommended  that  the  PADWSS  not 
be  utilized  on  an  operational  basis. 
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STATISTICAL  ANALYSIS  AND  SAMPLE  DATA 


A statistical  approach  was  used  to  handle  the  volume  of  data  that  was  gen- 
erated. These  calculations  are  summarized  below.  The  fleet  step  In  the 
analysis  Is  to  find  the  difference  between  the  two  systems.  This  Is  defined 
as: 

di  - da  - do 

where:  dj^  ■ the  difference  for  this  4sts  point 

d^  ~ the  wlndspeed  (or  wind  direction)  from  the  acoustic  system 

do  - the  corresponding  variable  from  the  system  with  which  the 
comparison  Is  being  made 

Next,  the  arithmetic  mean  or  average  difference  la  computed  by  summing  all  the 
Individual  differences  and  dividing  by  the  nuid>er  of  data  points. 
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j)  « di  + d2  + d3  + ...  + dji 
n 

where:  D > the  arlthematlc  mean 

di,  d2,  etc.  > are  the  Individual  differences 
n * the  number  of  data  points  Involved 
Finally  the  formula  used  for  the  standard  deviation  Is: 


where: 


s^ 


S - 


1 - 


(Sdj 

n 


n - 1 

the  standard  deviation  of  the  difference 
the  sum  from  point  one  through  point  n. 


A-1 


If  one  assumes  that  the  errors  induced  In  each  system  are  independant  of  one 
another,  the  standard  deviation  of  each  system  is  related  to  the  standard 
deviation  of  the  difference  by  the  following  equation: 


where 


the  standard  deviation  of  the  acoustic  system 

the  standard  deviation  of  the  system  which  is  compared  to 


the  acoustic  system 

Since  S is  calculated  from  the  data  collected,  this  equation  is  useful  for 
estimating  the  variability  of  the  systems  used  in  this  evaluation. 

EXPLANATION  OF  DATA  TABULATIONS. 

Listed  on  the  following  pages  is  a sample  of  the  data  from  the  PADWSS  versus  radar 
comparisons  for  October  27,  1977.  This  data  was  collected  using  6-minute  aver- 
ages and  was  included  as  part  of  the  normal  operation  data.  In  the  columns 
from  left  to  right  are  listed  the  date  that  data  were  collected,  the  time,  the 
PADWSS  reliability,  the  PADWSS  windspeed  and  direction,  the  radar  reliability, 
the  radar  windspeed  and  direction,  the  height  at  which  the  data  were  collected 
in  meters,  the  difference  in  speed  and  the  difference  in  direction. 

At  the  end  of  the  listing  is  printed  the  statistical  summary.  In  this  case, 
the  mean  difference  in  windspeed  is  0.98  m/s  (1.90  knots);  the  mean  difference 
in  direction  is  7.74°;  the  standard  deviation  of  the  difference  in  windspeed  is 
1.21  m/s  (2.35  knots);  and  the  standard  deviation  of  the  differences  in 
direction  is  17.16°. 
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TABLE  A-1.  TYPICAL  COMPUTER  DATA  SHEET 


TABLE  A-1.  TYPICAL  COMPUTER  DATA  SHEET  (CONT'D) 


